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Abstract 

Evolutionary game theory is a common framework to study the evolution of cooperation, where 
it is usually assumed that the same game is played in all interactions. Here, we investigate a model 
where the game that is played by two individuals is uniformly drawn from a sample of two different 
games. Using the master equation approach we show that the random mixture of two games is 
equivalent to play the average game when (i) the strategies are statistically independent of the 
game distribution and (ii) the transition rates are linear functions of the payoffs. We also use 
Monte-Carlo simulations in a two dimensional lattice and mean-held techniques to investigate the 
scenario when the two above conditions do not hold. We hnd that even outside of such conditions, 
several quantities characterizing the mixed-games are still the same as the ones obtained in the 
average game when the two games are not very different. 
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I. INTRODUCTION 


How is it possible for cooperation to exist in a system dominated by coimeti- 
tive and self-interested individuals? This is one of the big open questions in science [l|. It 
becomes more interesting when we realize that cooperation is not exclusively a human phe¬ 
nomena, it exists between different animal species |2|, within very organized insect societies 


and amongst kin [3| . If we generalize cooperation, using the framework of game theory, even 
between cells and RNA the concept can be used to model the emergence of organization in 
more complex and efficient forms QQ. 

In competitive systems it would be reasonable to think that selfish behaviour 
would be the best choice of strategy, so how can cooperation spontaneously emerge? Evolu¬ 
tionary Game Theory is often used to analyze such questions, specifically using the so called 
Dilemma Games jb, 7|. In such games players can cooperate to obtain a payoff, but there’s 
a temptation to betray the cooperator and get a better payoff. 

One of the simplest cases in game theory is the two-player game with only two 
possible strategies. Each player can choose either to cooperate (G) or to Defect (D) in each 
round. Although one player can interact with many other players, each round is played 
only by two individuals. The payoff matrix (G = (T, R, P, S)) represents how much the 
players gain from a single game and is normally state as: if both cooperated they receive R 
(Reward), if both defected they receive P (Punishment) and if they chose different strategies 
the defector receives T (Temptation) and the cooperator receives S (Sucker). These four 
parameters can describe different games j^, 8, 9|, being the Prisoners Dilemma (PD) the 
most canonical case, where T > R > P > S. This means that the best payoff is to defect 
when someone tries to cooperate with you. But if the whole population starts to defect the 
total payoff is lower than of a cooperating population. The Snow-Drift game (SD) happens 
when T > R > S > P. Observe that in this case it is worst when both players defect. This 
is a common game in animal contests where the damage of escalating conflicts is usually 
higher than being exploited [ij. The Stag-Hunt (SH) happens when R > T > P > S. Now 
it is better to imitate your opponent. This game can describe the behaviour of cooperative 
associations, where one can exploit the other, but the best results are achieved by cooperation 
[u|. The last case is the Harmony-Game (HG), characterized by i? > T and S > P. In this 
case it is always best to cooperate. 
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The evolution of cooperation in well-mixed populations can be described by 
mean-field equations, like the replicator equation jb]. It predicts that cooperation cannot 
survive, a conclusion that does not seems to happen in nature j^, 8, 12|. Many mechanisms 
rave been proposed to explain the survival of cooperation: direct and indirect reciprocity 
151, volunteering 161, spatial selection multi-level and kin selection j^. The essen- 


12 


tial feature of these mechanisms is that cooperators interact more often between themselves 
than with defectors. For example, spatial reciprocity happens when individuals are located 
in the vertices of a graph and can interact only with their neighbours. Cooperators spon¬ 
taneously form clusters of cooperation that survive in a sea of defectors for a wide range 


of parameters Q|. Most models assume that only one game is repeatedly played in all in¬ 
teractions. However, there is nothing a priori precluding the coexistence of different games 
in a population. For example, players can have different perceptions of the rewards, giving 
rise to a multi-game scenario. In this case, individuals play asymmetric garnes, where the 
payoff matrix of one player is different from the payoff matrix of his co-player 18|, ll9|]. Here, 
we study a model where different payoff matrices are randomly assigned to each interac¬ 


tion - the mixed-game model j^. Different from the multi-game model, here the game is 
symmetric, that is, in each round both players use the same payoff matrix. 

The mixed-game model is presented in the next section. In section HI we develop 
the master equation approach for mixed-games. We show that these equations are identical 
to the ones where the evolution is driven by a single game with payoff given by the average 
of the two games (average game), when particular conditions hold. In section IV we use 
Monte-Carlo simulations to investigate the evolution of the cooperators for mixed-games in 
a two-dimensional lattice. We also analyze how robust is the result of one cooperative game 
if there is a chance of a more selhsh game be played and compare the mixed-game model 
to the average game. The relation of the master equation with the replicator equation is 
discussed in Appendix A. Appendix B contains the development of the pair-approximation 
model used to study the mixed-games. Finally, we present our conclusions in the last section. 


II. THE MODEL 

We simulate the evolution of cooperation in populations structured on two- 
dimensional square lattices with first neighbour interactions and periodic boundary con- 
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ditions. Initially, each individual is assigned to one strategy {C oi D) with equal probabil¬ 
ity. The strategies determine the payoff obtained on pairwise interactions. We choose to 
parametrize R=l, P=0, T G [0, 2] and S G [—1,1] to obtain an useful parameter space that 
contains all four games (HG, SH, PD and SD), as can be seeing in £gure[TJ By doing so we 
can analyze how the fraction of cooperators in the stationary state {p{t oo)) is affected 
by such parameters 



FIG. 1. Parameter space in T and S for the possible payoff matrices. Using R=1 and P=0 we 
have the four games (HG, SD, PD, SH) well defined in each quadrant. For every two single games 
(SH=Gi, and SD=G 2 , for example) there will be a mean game that is in the medium point between 
the two games. This mean game can be a totally different game (PD), as is shown in the example 
above. 


The evolutionary process of mixed-games is composed of two parts: the game 
phase and the imitation phase. In the game phase, each individual plays one round of a game 
with each one of his four neighbours and the payoff obtained in each interaction is added to 
the cumulative payoff of each player. The games to be played are randomly assigned to each 
interaction: Gi = (Ti, S'!) with probability ta or G 2 = (T 2 , S 2 ) with probability 1 — w. In the 
imitation phase, individuals may update their strategies by imitating the strategy adopted 
by more successful neighbours: the focal individual i randomly chooses one neighbour j to 
copy his strategy with probability p{Auij) depending on the payoff difference Auij = Uj — Ui, 
where Ui is the cumulative payoff of player i. For the strategy update probabilities, we use 


the Fermi-Dirac and the Proportional Imitation rule p, l20| : 


p{Aui,) = 1 / (1 + 


( 1 ) 
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p{Auij) = max[(uj — Ui), 0]/b , 


(2) 


respectively. The parameter 6 is a normalizing factor and K is the parameter controlling 
the strength of selection pressure on strategies (8|. 

The game and the imitation phases can be implemented synchronously, partially 
asynchronously, or totally asynchronously js, 21|. In the synchronous protocol, in each 
Monte Carlo step (MCS) the cumulative payoffs are set to zero, games are randomly and 
independently assigned to each one of the interactions, and the cumulative payoff of every 
player is calculated. Then all players simultaneously proceed to the imitation phase. In 
the totally asynchronous protocol the cumulative payoffs are set to zero, a randomly chosen 
focal player and his four neighbours play randomly and independently assigned games with 
their respective neighbours, the cumulative payoff of these hve players is calculated, and, 
hnally only the focal player proceeds to the imitation phase. This process is repeated until 
all nodes have equal chance to update their strategies at least once - this defines one Monte 
Carlo step (MCS). In the partially asynchronous protocol, the games that each player will 
play with its neighbour are assigned only once at the beginning of each MCS - as in the 
synchronous protocol - and then strategies are update asynchronously. In this work, all 
protocols yields the same qualitative results. 

We measure the cooperation level as the average number of cooperators p in the 
stationary state. We compare the evolution of cooperation in the mixed-game case to the 
case where only the average game Gm = (G) = wGi -|- (1 — t(;)G 2 is played and to the cases 
where only Gi or G 2 is played. 


III. MASTER EQUATION APPROACH 

Perhaps the first interesting question is about the equivalence between the mixed- 
games and the average game. In this section we investigate such equivalence for the asyn¬ 
chronous update. Obviously we are unable to solve the master equation exactly. However, 
we are able to establish conditions that allow us to show this equivalence. These condition 
are : (i) the strategies are statistically independent of the game distribution and (ii) the 
transition rates are linear functions of the payoffs. The main result of this section can be 
used as a guideline for more general problems. 

At each time t such system is characterized by the strategy configuration {s} = 
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{si, S 2 , ■■■Sn}, where Si is the strategy of player i, and by the game assignment conhguration 
{g} = {gi 2 ,gi 3 , ■ ■ The variable gij is uniformly distributed over the discrete set of values 
{1, 2}, determining which one of the two games, Gi or G 2 , are to be played in the interaction 
between player i and its next neighbour j. Note also that each link i,j is statistically 
independent of the other links. Let P({s}, t) be the probability to hnd the mixed-game 
system in the conhguration {s} and {g} at time t. The time evolution of this system is 
given by 




E PiM'’ {3}'.t)w(UY, {sY -a { 0 }. { 9 }) 

-Pi{s}A9},t)Wi{s}A9} ^ {sYAg}') , 


(3) 


where W ({s}', {g}' {s}, {^f}) is the transition rate from the state ({s}', {(?}') to ({s}, {( 7 }). 

If the initial game assignment probability distribution is the stationary distribution 0 = 
n.y ^i9i: j), 0 is independent of time. Here we have that 9{g) = w6g^i + {l—w)Sg^ 2 - Supposing 
the condition (i) that the strategy variables {s} are statistically independent of the game 
variables {g}, we can write that P({s}, { 5 ^}, t) = P({s}, f)P({( 7 }). To simplify the the 
notation, from now on we write s and g instead of {s} and {g}. The master equation can 
now be written as 

P(9)j/(a, () = E t)P(9'W(s', g' -g s, g) 

s',g' 

-P{s,t)P{g)W{s,g^s\g') . (4) 


The mean value of a function / averaged over all game conhgurations is (/)^ = fP{g). 
Using this, we can sum in g in both sides of equation (jl]) to obtain that 


d 






E^’(s.o 


EW)»r(i!'.9'^i>.9) 

9' 

Y,P{9)W{s,g^s\g') 


Since the quantities inside square brackets are the averaged values of W over g{g') we have 
that 

«) = 2 ,P(s', i)rp W(s', g' -g s, g) 


- E s'P{s, t) l'^W{s,g ^ s', g') 


(5) 
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The transition rates W will be obtained from each microscopical rule (pro¬ 
portional imitation, Fermi-Dirac, copy the best, etc.), and will depend on the payoff 
differences(AMjj) of neighbouring sites, topology of the lattice and the copy mechanism. 
Since the dynamical process in a time step, in our model, always involves only one site, for 
example site i, copying the strategy of a neighbour, say j, all the transition rates in which 
the new g' has a link that is not connected to site i are null. Moreover all these rules are 
explicitly independent of the future game to be played, making the summation inside the 
averages lead to a finite constant k that will only depend on the geometry of the lattice and 
on some aspects of the microscopic model. It follows that 

^ s,g)\ = K{W{g',s'^ s))g, . (6) 

\ <? I g! 

Notice that for simplicity we hide from the transition rates W (s', g' —?■ s, g] Auij) 

variables, although it depends on it. In regular lattices k is the same constant for every site 
and can be absorbed in the time variable and we get 


A 

dt 


Pis, t) = Y^ Pis', t) {W{g, s' s))g - ^ P(s, t) {W{g, s s'))^ . 


(7) 


If we use condition (ii), that the update rules are linear on the payoff, the average over the 
transition rules will become simply the the transition rates of the average payoff, namely 


iWis',g' s,g-,Auij)) = W{s',g' s,g; {Auij) ) 


( 8 ) 


Using this relation in equation [71 we obtain that 


d 


() = P(s', t)W(s' ^ s; {G» - P(s, t)W(s^ s'; (G)) , 


(9) 


where (G) stands for the average payoff matrix. This equation implies that the time evo¬ 
lution of the configuration probability in a mixed-game with asynchronous update is equal 
to the time evolution of a single game jb] with the transition rates evaluated by using the 
average payoff matrix. Note this equation also describes the classical evolution of a single 
game if we use the appropriate transition rates. 

It is worth mentioning that this result also holds for more general game assign¬ 
ment distributions. Supposing that 6g = X]fc=i '^kdg,k, where Wk is the probability of play 
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FIG. 2. (Color Online) Integration of the mean-field, pair-approximation, ODE by a Runge-Kutta 
algorithm, (a) Phase transition of the stationary state value of cooperators in different single games 
(Gi, G 2 and Gm) and the mixed-game {Gx)- Gm{Sm = 0) is the mean game of Gi(5i = —0.1) 
and G2(5 'i = 0.1), GX is the model where both Gi and G 2 are played with equal probability, (b) 
Time evolution of cooperators for each game, here T = 1.1 . Although the mixed-game behaves 
differently for small times, the fraction of cooperators in the stationary state is similar. 


the game {k = 1,... ,n), we can easily see that the argument remains the same. The 
only difference is that the average payoff matrix is now given by (G) = '^kGk. 

We emphasize that equation ([9]) was obtained by assuming that the variables {s} 
and {g} are not correlated, condition (i). Also the equivalence between the average and the 
mixed-games only holds for the master equation as long as the transitions rates are linear 
on the payoff, condition (ii). 

In Appendix A we expand the replicator equation model to include mixed-games. 


The numerical solution of the master equation can be rehned into more accurate moc 


consider spacial interactions. Appendix B shows the classic pair approximation 20, 


els that 


22 I I and 


how we expanded it to include mixed-games in a square lattice. Our numerical solution 
shows that the mixed-game is equivalent to the mean game. But in the pair approximation 
this only holds as long as the parameters (T and S) of the mixed-games are close enough 
from the mean game. The obtained results are shown in hgure [2j 






















IV. MONTE CARLO SIMULATIONS 


Let us now study the mixed-game model with populations structured in a two- 
dimensional square lattice. Since the variables Qij defining the game between sites i and 
j obeys the stationary probability distribution 0 = -|- (1 — w)5g^^^2\) they are 

independent of the strategy’s variables. On the other hand, the probability of s* and Sj 
have particular values, (U, C) for example, depends if the game between them is Gi or G 2 . 
Therefore condition (i) is not obeyed. Moreover, the transitions rates are not linear when 
we use the payoffs defined by equations ([T]) and ([2]). This implies that condition (ii) is 
also not obeyed. To investigate the effect of breaking conditions (i) and (ii), we performed 
Monte-Carlo simulations on the square lattice. Simulations were performed on lattices with 
sizes(L) ranging from 100 x 100 to 500 x 500. All quantities are averaged over 20 initial 
conditions and let termalize for at least 3000 Monte-Carlo steps for each run. It turns out 


a b 




FIG. 3. (Color Online) (a) Phase transition of cooperators in different PD games for an asyn¬ 
chronous model,L = 100. 0^(5" = — 0 . 02 ) is the mean game of Gi(5 = —0.01) and 02 ( 6 ' = —0.03), 
GX is the model where both Gi and G 2 are played, (b) Phase transition in different games for a 
synchronous model, L = 200. Here Gi(T > 1.05, S = 0.02) is a SD game, G 2 (T' > 0.95, S = —0.05) 
a SH and the mean game Gm(T > IjS" = —0.01) is a PD. The mix of those two different games 
still behaves as a PD. 

that if the difference between Gi and G 2 is small, the evolution of cooperation in a mixed- 
game is equivalent to the average game G^, as shown in figure |3l Interestingly, figure |3]-(b) 
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FIG. 4. (Color Online) Difference in the cooperation from the mean game and mixed-games versus 
the difference from the parameter Si and 82 - The dashed line corresponds to the mean game 
value of cooperation, squares point the data from the Proportional Imitation model and circles the 
Fermi-Dirac. Until A = 1 the Proportional Imitation model just fluctuates around the mean game 
value, while the Fermi-Dirac progressive rises. The cooperator differences are of 10“^ order. 


O Fermi-Dirac 
□ Proportional Imitation 


C) 

C) 



shows that cooperation may thrive in the presence of disadvantageous payoff matrix values 
as long as the average game is a favourable one. Notice that the mixed-game behaves as the 
mean game even when the two games are of different kinds, as shown in hgure [3]-(b), where 
Gi is a SD and G 2 is SH game. 

Figure m shows the difference between the fraction of cooperators for the mixture 
of games Gi = (1.04,5') and G 2 = (1.04,—S') and the fraction of cooperation for the 
corresponding average game G^- If the difference between the games Gi and G 2 grows, 
then the equivalence no longer holds. Hence, our simulations suggest that, even if the 
update rules are non-linear, the equivalence between average and mixed-game may hold as 
long as the difference between the games Gi and G 2 is small. Nevertheless, the fraction of 
cooperation differs at most 0.1. The small deviations contrast with the results obtained in 


18|, [lOj], where the authors modelled multi-games as a result of different perceptions of the 
interactions. In their paper the games are asymmetric, meaning that the interface between 
cooperators and defectors can be benehcial for cooperators, strengthening even more the 
expansion of cooperation clusters. In our model, the symmetric games are randomly assigned 
every time step and the two players always have the same perception of the game. Hence, 
the cooperators on the interface can thrive only if the average game is cooperative. 
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V. CONCLUSION 


We investigated under which circumstances the evolution of cooperation in the 
mixed-game model is equivalent to play a single game dehned as the average between the 
two games in the mixed-game model. Using a master equation approach we showed that 
the time evolution of a mixed-game with asynchronous update is equivalent to the average 
game if the transition rates are linear in the payoff and if there are no correlations between 
the game played and the state of the player. Using both synchronous and asynchronous 
Monte-Carlo simulations in the square lattice, we investigated the effects of (i) non-linear 
update rules and of (ii) correlations between the strategy and game assignment variables. 
We found that, as long as the differences between the two games are small, the mixed-game 
and the average game are equivalent. We showed also that assigning different games to 
interactions is not the same as to say that individuals have different asymmetric perceptions 
of the interaction. 
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VI. APPENDIX A 


We now derive the replicator equation for mixed-games. Suppose an inhnite 
population of strategists where everybody interacts with everybody. Associating the mean 
payoff of a strategy with its capability of ’’reproduction” we can obtain mean held equations 
for the dynamics of the strategy population. The most simple cases comes without consid¬ 
ering spatial effects and usin g ju st a single game being played. The replicator equation for 


this model can be written 


0 , 


23l | in terms of games as 


Xi = Xi[fi{x) - 4){x)] . 


(Al) 


Here Xi is the fraction of players using strategy i (in our case C or D), fi{x) can be 
regarded as the mean payoff of strategy i, and 0(x) is the total population average payoff. 


This mean held dynamics can be mapped into a master equation of a Markovian chain 
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that represents each player changing its state using some transition rule. It follows that 


Xi = - XiUJij{x)] 

j 


(A2) 


Here 0 Jij{x) is the individual transition rate of a player from state i to j, and can be obtained 
from the microscopic rule that states how one site copies the strategy of another. Many 
different microscopical rules have been proposed, such as Imitate the Best, Best response, 
Fermi-Dirac probability and Proportional Imitation rule. As can be expected, each one of 
this rules changes the results of the replicator dynamics, leading to different final results. The 
most common cases are the Maynard-Smith and Taylor-Johnsen equations 2J, [2^ which 
can be obtained from the Proportional Imitation and Moran process microscopical rules j^. 

Now we generalize this result to mixed-games. Being able to play two different 
games at each interaction, the payoff matrix G, will be now a statistical quantity, with mean 
value Gm- This leads to a change in the transition rates of the model, where the microscopic 
rule now depends on a probability distribution (0) of games being played. Although we are 
changing the game being played, the replicator equation still maintain their dependence 
with the payoff (i.e. fi{x))- If we average the replicator equation in the game assignment 
variables, we obtain that 


^^*^5 = - XiUJij{x)]^ = '^[Xj {ujji{x))g - Xi {Uij{x))g] 


(A3) 


If we use any transition rule that is linear in G, this will lead {uij{x)) = oJij^x] (G)) that is 
equivalent to playing the mean game Gm = wGi + (1 — w)G 2 . This description agree with 
the one obtained from equation (|9]). Note that these results are also valid if we use the more 
general game distribution 9g = J2k=i'^kSg,k- 


VII. APPENDIX B 

The simplest way to describe a repeated game is by using a mean-field approx¬ 
imation. Here it is supposed that all individuals play with all other players in an inhnite 
population. By doing this one can expect to obtain the mean payoff of a cooperator (uc) or 
defector (ud) using the payoff matrix and the abundance of other defectors or cooperators. 
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In this simple model we have: 


Uc = Rpc + Spd (Bl) 

Ud = Tpc + Ppd , (B2) 


where pc and pd are the fraction of cooperators and defectors of the population. Inserting 
these payoffs in the replicator equation flAip as the fitness of each strategy, we obtain the time 
evolution of such strategies as predicted by a mean-field approximation. This framework 
does not account for spacial effects such as lattices topologies or number of neighbours and 
results in a scenario where only one specie survives, depending on the parameters. There is 
no coexistence. Notice that in this model the payoff is a linear function of the parameters, 
so it’s equivalent to play a mean game and averaging the payoffs of two mixed-games 
Gi and G 2 . 


m 
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The simplest way to take into account the lattice is by using the pair-approximation 


26| . Here we no longer suppose that all individuals are connected to everyone 


else. Instead we use a square lattice with interaction between the first next neighbours and 
analyze a cluster of two focal sites {i and j) and their nearest next neighbours {x,y,z and 
u, V, w) as it is shown in figure [5l Sites i and j have their payoff calculated exactly as they 
play games with cluster sites, while the neighbouring sites have an exact payoff calculated 
with i or j and the other 3 games (the second neighbours sites) payoffs are calculated by a 
mean value using a one site approximation. 


To obtain the dynamics for this system we use the master equation ([3]). Now, 
instead of using P({s}, {^f}, t) as the main variable, we use the probability that a connec¬ 
tion between two sites is in the current state Tq,^^ (a and (3 can be C or D in this case). 
lT({s}, {g} —)■ {s}^ {g}') become the rates that each link changes from one state to another 
{cd —>■ cc for example). And we further simplify for the single game case ({( 7 } = Later 

we analyze the mixed-game models. This gives us three coupled ODE’s that states how the 
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FIG. 5. The cluster structure used in the mean field-calculations. Although all seven main con¬ 
nections can give exact payoff between the sites, the second order neighbours (shown here as “...”) 
payoffs needs to be calculated as a mean value using one site approximation. All eight sites can be 
either C or D and each connection can be in the states Fee, Fed and 

fraction of possible connections in the cluster evolves: 

tec = cd)Wed^cc{k} - P{{ky, Cc)Wec^cd{k} , (B3) 

{k} 

ted = Cc)Wee^ed{k} + P{{k}-dd)Wdd^ed{k} 

{k} 

- P({fc}; cd)Wed^ee{k} - P({A:}; cd)Wed^dd{k} , (B4) 

{fc} 

Here {k} is the conhguration which describes the sites strategies, P({/c}; a(3) is the probabil¬ 
ity that the system is found in conhguration {k}, given that exists at least one connection of 
the type a/3 and the summation occurs over every possible conhguration that allows each one 
of the given transitions. The summation occurs over every possible cluster state, although in 
certain states the rate Wa^^'yg that a pair can change is zero. We use the system constrains 
to reduce the problem to the resolution of only two ODE’s, namely Tec + = 1, 
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Pc = Tec + rcd/2 and Pc + Pd = 1- Each rate W is calculated by counting every possible 
transition of the system from one state to the other and weighting it by the transition prob¬ 
ability p{uij). Notice that as we look for changes in the links, not only i and j can change, 
but any of the seven links composing the cluster. In a broad sense each term in the ODE’s 
is composed of only three terms: 


P({fc}; a(3)Wal3^'yl3 — Aa/d + -Ba/3 + C'o/? • (E6) 


These terms represent the only possible processes that can change the links of the cluster 
in one interaction: A) the focal site copies the strategy of the other focal site, B) the focal 
site copies the strategies of a second order neighbour, C) the second order neighbour copies 
the strategy of focal site. This can be seen in hgure O These processes have a general form 
that depends on the two sites that will remain fixed in the summation (i.e. a,/3 being fixed 
C or D depending on each rate Wa/d^'y/s ) 


A(i=aJ=^) Tjp 


x,y,z v,w,u 


r r r r r r 

tx^ ly^ iz ^ 3"^^ 3'^^ 3'^ 


r? 


u p3 


p(Auij) , 


B{i=a,x=fi) 




y,z v,w^u j 


r r r r r r 

tx-^ ly^ iz yy JU^ JV^ JW 


r? 


u p3 
j 




^(i=^,x=a) — 3 ^ ^ ^ 


y,z v,w,u J 


r r r r r r 

tx^ ly^ iz 3"^^ 3'^^ 3'^ 


r? 


u p3 

j 


p{Au^i) . 


(B7) 

(B8) 

(B9) 


Here we multiplied by 3 the terms B and C to account for the number of equivalent repetitions 
of the same conhguration that can occur due to symmetries, is the number of neighbours 
of the current site in the same state as the site being copied (i.e. the number of links that will 
change if the current site changes its configuration), pp is always one for the C process, as it 
always changes just one link in the cluster. The quantity inside the square brackets gives the 
probability that the entire cluster will be in a given configuration {k} = (x, y, z, v, w, u, i,j). 
Lastly p{Auab) is given by the chosen microscopic transition rule, and gives the probability 
(given such conhguration of the cluster) that the selected site (a) will copy its neighbour’s 
(&) strategy, based on their payoff differences Auab- The payoff of any focal site is easy to 
be exactly obtained as Ui = G{i, x) + G{i, y) + G{i, z) -|- G{i,j) (G is the game matrix). For 
the payoff of any neighbouring site x,y or z we need to get the mean payoffs using a one site 
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FIG. 6. Example of the three process that can change any link Fed to F^^ in the cluster. Notice 
that this figure is just an example using process for the rate Wed-^dd- Each of the other rates 
Wai 3 ^'y /3 have three similar process, exchanging a, /3 and 7 for the appropriate C or D. 

approximation, namely 

Uc = S + pli3S) + 3plpc{2S + R) + 3pdpl{S + 2R)+pl{3R) , (BIO) 

Ud = T + p^{3p) + 3p'^Pc{2p + T) + 3pdpl{p + 2T) + pI{3T) . (Bll) 

Here Uc is the mean payoff when the neighbour site is a cooperator and the focal site is a 
defector, and Ud is the payoff of the opposite situation. 

The counting of every possibility of a site changing its strategy is complicated 
and give rise to about 2® separated terms. Nonetheless, after determining a closed form for 
A, B and C for every rate IT, it’s a simple computational task to obtain all terms of 
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By doing so we obtain two coupled ODE’s that can be numerically solved. We emp 


that this kind of mean-field results were already obtained in the literature 


2d, 
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nasize 


26|. 


Returning to the mixed-game problem, we used two possible games (Gi and 
G 2 ) being played at each interaction. To insert this in the mean-field model with cluster 
approximation we have now to reconsider all the possible site payoffs. Instead of having 
just one payoff matrix being used for each interaction, we now have several different matrix 
weighted by their probability. This means that we have to sum over all the possible payoffs 
obtained with each site’s neighbour in each game. It’s equivalently, in our rate terms W, to 
change the payoff function piua/i) into a sum over all possible games (X]{g} fgi'^ais)) between 
the sites to be considered and its neighbours. It is important to notice however that the 
summation occurs over every neighbour of a and (3 as the payoff of each site is determined 
by the sum of games played with every neighbour. 

As each of the two sites being considered for each rate W have 4 neighbours, this 
give rise to 2® possibilities of different game configurations on the cluster. Notice however 
that the ODE’s remains covariant as T and the symmetry constants do not explicitly depend 
on the game being played. We can average over {^f}, a vector that gives the configuration 
of each game being played, using it’s probability distribution Q{g). By doing so we obtain 
the new rates 


• (B12) 

{9} 

Making this change in the ODE and using a fourth order Runge-Kutta integration, we 
obtained the numerical results displayed in figure O Notice that as the payoff of each site 
depends on four other neighbours we need to consider every conhguration of games being 
played by the sites in each term of W. This is why we cannot just sum up linearly the two 
different game matrices to obtain a mean payoff. 
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